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Título: Propiedades psicométricas de la Liverpool Stoicism Scale (LSS) en 
una cohorte de pacientes con cáncer resecado en tratamiento adyuvante. 
Resumen: El estoicismo se ha utilizado para describir una amplia gama de 
comportamientos frente a la enfermedad que van desde el silencio a la re- 
sistencia a la adversidad. Este estudio tiene dos objetivos: 1) analizar las 
propiedades psicométricas de la versión española del LSS; 2) evaluar la re- 
lación entre estoicismo, género, edad y el modelo de los cinco grandes fac- 
tores de personalidad. NEOcoping es un estudio prospectivo, multicéntri- 
co, observacional, no-intervencionista. Los pacientes fueron reclutados 
consecutivamente en 13 hospitales universitarios de España. Se aplicó la 
Liverpool Stoicism Scale (LSS) y el Big Five Inventory (BFI-10). Participaron 
443 pacientes (250 mujeres) con una edad media de 59,8 años ($D =12,3). 
El cáncer de colon y mama fueron los más frecuentes. A nivel de escala to- 
tal, la puntuación media de la LSS fue inferior a la muestra Británica. La es- 
tructura propuesta en cuatro factores proporciona un buen ajuste a los da- 
tos, y las puntuaciones en las escalas derivadas presentan fiabilidades acep- 
tables. El rasgo de personalidad de introversión fue capaz de predecir el 
4,1% de la variancia de estoicismo (p<,001). Aunque debe ser mejorada, la 
LSS presenta globalmente unas propiedades psicométricas aceptables para 
evaluar el estoicismo en pacientes españoles con cáncer resecado. 

Palabras clave: Actitud; estoicismo; cancer; estudio psicométrico; perso- 
nalidad; afrontamiento. 


Abstract: Stoicism has been used to describe a wide range of behaviors in 
the face of disease that go from silence, resistance to the adversity, or ‘to 
make the best of a bad disease”. This study pursued two objectives: 1) ana- 
lyze the psychometric properties of the Spanish version of the LSS; 2) as- 
sess the relation between stoicism and gender, age, and the five-factor per- 
sonality model. NEOcoping is a prospective, multicenter, observational, 
non-interventionist study. Patients were recruited consecutively at thirteen 
Spanish teaching hospitals. The following scales were administered: Liver- 
pool Stoicism Scale (LSS) and Big Five Inventory (BFI-10). A total of 443 
patients (250 females) with a mean age of 59.8 years (SD =12,3) were en- 
rolled. Colon cancer was the most common, followed by breast cancer. At 
the total-scale level, mean LSS was lower than the originally reported Brit- 
ish sample. The four-factor structure fitted the data well, had a clear inter- 
pretation, and the derived scales showed acceptable reliabilities. The per- 
sonality trait of introversion predicted 4.1% of the variance of stoicism 
(p<.001). Even though it needs to be improved, the LSS scale demon- 
strates acceptable psychometric properties to appraise stoicism in the 
Spanish population with resected cancer. 

Key words: Attitude; stoicism; cancer; psychometric study. 


Introduction 


Stoicism, the philosophy of the stoics, followers of Zeno of 
Citium (334 B.C. - 260 B.C.) advocated, among other prem- 
ises, keeping calm in situations of difficulty, and acceptance 
of adversity without complaint (Addis & Mahalik, 2003; 
Erskine, 2000). In its classical interpretation, the concept as- 
serted that personal indifference in light of the pain-pleasure 
binomial, as well as strict control of the emotional, as the 
best way to achieve happiness. More recently, Wagstaff and 
Rovledge (1995) depicted the concept of stoicism as a trait 
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or disposition characterized by the lack of emotional expres- 
sion and increased capacity to withstand life’s vicissitudes. 
Despite the possible explanatory nature this might have 
in the field of the health, and especially in oncological pa- 
tients, stoicism has been fairly ignored in these spheres 
(Becker, 2003; Spiers, 2006). Within its phenomenology, sto- 
icism has been used to describe a wide range of behaviors in 
the face of disease that go from silence, resistance to the ad- 
versity, bearing pain without complaining, or ‘to make the 
best of a bad job’ (Spiers, 2006). Some studies have shown 
that the adaptive or maladaptive effects of stoicism as a per- 
sonality trait would be highly sensitive to the context of 
health, and that might have treatment and prognostic impli- 
cations (Furnham, Petrides, Sisterson, & Baluch, 2003; 
Murray et al., 2008; Spiers, 2006; Witte, Gordon, Smith, & 
Van Orden, 2012). Thus, for Spiers (2006) a stoical attitude 
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in the face of pain would be particularly adaptive and effica- 
cious in the degree to which the person conserved their abil- 
ity to know their own limits and will adopt proactive 
measures to keep the symptomatology, p.e. pain, within the- 
se acceptable limits. In contrast, the stoical attitude would 
restrict attempts at appropriate medical intervention and it 
would therefore be maladaptive if the inconsistency between 
the stoical individual’s verbal and non-verbal behavior hin- 
dered the appreciation of patient’s actual clinical situation 
(p.e. an individual who suffers intense pain, but doesn't 
show it). Several investigations have suggested that measur- 
ing this construct could be useful in certain clinical contexts 
(Buckley & O Tuama, 2010; George & Fleming, 2004; 
Moore, Grime, Campbell, & Richardson, 2013; Murray et al., 
2008; O’Brien, Hunt, & Hart, 2005; Yong, 2006). Hence, 
better characterization of stoical patients would enable more 
efficacious strategies to be designed for interventions such as 
decision-making in oncology. 

At present, the only psychometrically validated tool to 
measure stoical traits is the Liverpool Stoicism Scale (LSS). 
According to Wagstaff and Rovledge (1995), the LSS hinges 
on a definition of stoicism based on the absence of emotion- 
al involvement (for instance, «I do not get emotionally in- 
volved when I see suffering on television»), the non- 
expression of emotion (for instance, «I tend not to express 
my emotions»), and the ability to withstand difficulties (for 
instance, «One should keep a ‘stiff upper lip’») (Furnham et 
al., 2003; Murray et al., 2008; Wagstaff & Rowledge, 1995). 
In the process of designing the LSS, the authors did not 
conduct a factor analysis, and the scale was directly consid- 
ered as unidimensional, measuring a single general construct. 
Subsequent factorial studies aimed at assessing the dimen- 
sionality and structure of the LSS have not arrived at con- 
sistent results. Authors such as Furnham et al. (2003) have 
highlighted the presence of four factors that would account 
for 47% of the variance, Gaitniece-Putafie (2005) have posit- 
ed a three-factor model that would explain 37.9% of scale or, 
a single-factor model, albeit eliminating the items with a low- 
er factor loading, whereas Murray et al. (2008) propose the 
scale’s unidimensional structure that would account for 
25.9% of the variance. 

Currently, the LSS has not been translated or validated in 
Spanish, limiting its use in Spanish-speaking patients from a 
specific cultural and social context. A sample of patients who 
had undergone surgery for cancer in its early stage, after the 
first consultation with the oncologist to decide on adjuvant 
treatment has been used as a model for the scale’s adaptation 
into Spanish. Despite the fact that this cohort has a relatively 
good short-term prognosis following neoplasm resection, it 
is an interesting population to appraise the effect of resigna- 
tion in non-terminal patients. These individuals must con- 
front the perspective of a treatment, adjuvant chemotherapy 
that is loaded with uncertainty as to prognosis, efficacy, and 
tolerance. Thus, stoical traits could affect specific decision- 
making, be barriers to communication, and cause clinical un- 
certainty with impoverished quality of life, tolerance to 
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treatments, and the emergence of adverse effects, such as 
anxiety and depression and could influence prognosis 
(Spiers, 2006). 

The use of the LSS-based measures of stoicism suggests 
that men have higher levels of stoicism (Wagstaff & 
Rowledge, 1995), which is consistent with the traditional no- 
tion that stoicism is associated with being male (Fergus, 
Gray, Fitch, Labrecque, & Phillips, 2002; Seale, 2002) and 
older adult (Moore et al., 2013; Yong, 2006). Some authors 
have suggested that men and older adults are more stoical 
because it is harder for them to identify and express their 
emotions (Gaitniece-Putane, 2006). However, Pinnock, 
O’Brien, and Marshall (1998) point out that stoicism could 
be a potentially maladaptive behavior linked to negative atti- 
tudes toward pursuing psychological help. When men per- 
ceive disease as ‘weakness’, they tend to adopt a more stoical 
attitude and seek less help (Addis & Mahalik, 2003; Pinnock 
et al., 1998). Sobralske (2006) attributed this to the fear and 
shame of appearing less manly. Also, stoicism can be consid- 
ered a trait or disposition of personality, Murray et al. (2008) 
found that stoicism is inversely related to the openness to 
experience and they considered that openness was a predic- 
tor of emotional sensitivity to the change (Murray, Allen, 
Rawlings, & Trinder, 2002). It is in this regard that stoicism 
may be more related with personality trait of introversion. 
Introverted people tend to have qualities such as quiet and 
reserved (Park et al., 2013). 

The general purpose of this study is to assess the psy- 
chometric properties of the Spanish version of the LSS in 
the population above described. The first part of the assess- 
ment is internal, and focuses on the dimensionality and 
structure of the scale, as well as the reliability of the derived 
scores. The second part is a validity study aimed at assessing 
the relationship between stoicism and gender, age, and the 
dimensions of the five factor personality model. 


Method 
Participants 


Suitable patients for inclusion were adults (218 years) 
who had a histologically confirmed, non-advanced solid tu- 
mor treated with surgery for which international clinical 
guidelines consider that adjuvant treatment may be an op- 
tion. The patient should be expected to be followed in the 
center where the first visit takes place during all adjuvant 
treatment. The evaluation was performed in all cases approx- 
imately 2-4 weeks following of the operation, within the con- 
text of the patients’ first visit to Medical Oncology Depart- 
ment to decide on adjuvant chemotherapy with or without 
radiotherapy, once any possible complications from the sur- 
gery had passed. 

Patients were excluded if they had a metastatic disease, if 
they were treated with preoperative radiotherapy or chemo- 
therapy or only with adjuvant hormonal therapy or radio- 
therapy without chemotherapy. Patients having physical 
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conditions, comorbidity and/or age that preclude chemo- 
therapy and those with personal, psychological, family, so- 
ciological, geographical, and/or underlying medical condi- 
tion that, in the investigator’s opinion, might hinder the in- 
dividual's ability to participate in the study were also exclud- 
ed, given that these patients did not have to confront the 
resignation of the decision-making process regarding adju- 
vant therapy. 

Of the 488 patients screened, 45 were not eligible (14 did 
not meet inclusion criteria; 26 met exclusion criteria and 15 
had incomplete data). The final analyzable sample comprises 
443 subjects (183 men and 250 women) with a mean age of 
59.8 years (SD = 12.3). Colon cancer was the most usual 
(40.0%, n =177), followed by breast (32.7%, n = 145) and 
stomach cancer (6.8%, n = 30). Half of the participants had 
stage I-II disease and the other half had stage HI cancer. Re- 
garding the variables associated with the sex, 61% of men 
had colon cancer, of which 63% were stage III, while 56% 
of women had breast cancer, 41% in stage II. All the sub- 
jects were deemed to be candidates for adjuvant treatment, 
with concomitant radiotherapy in 35.2% of the cases. The 
mean time between the operation and oncologist consulta- 
tion was 2.8 weeks (SD = 1.5) and 85% were evaluated in 
less than one month from the operation. Baseline character- 
istics are presented in Table 1. 


Table 1. Participants’ characteristics (7 = 443). 


Characteristics n % 
Women 250 56.4 
Age (years, Mean; SD) 59.8 (12.3) 
ECOG 
0-1 428 97.1 
Primary tumor 
Colon 177 40 
Breast 145 32.7 
Stomach 30 6.8 
Others 91 20.5 
Stage 
I-II 233 52.5 
II 210 47.5 
Adjuvant radiotherapy 156 35.2 
Family history of cancer 202 45.6 
Demographic factors 
Residency: town 188 42.4 
Patients live with a partner 346 79.9 
Children in the family 
No children 75 17.2 
One or two children 266 61.4 
Three or more children 102 23.5 
Primary studies 252 56.9 
Not working 256 64.6 


Abbreviations: 1: number SD: Standard Deviation. 
Study design and setting 


NEOcoping is a prospective, multicenter, observational 
study without intervention and patients were recruited con- 
secutively from June 2015 to September 2016 in 13 Spanish 
teaching hospitals. The study is supported by Continuous 


Care Working Group of the Spanish Society of Medical On- 
cology (SEOM, for its acronym in Spanish). 

The protocol was approved by the Ethics Committee at 
each hospital in accordance with the 1964 Declaration of 
Helsinki, revised in Seoul in 2008. Data collection was simi- 
lar for all hospitals. Following a full explanation of the study 
objectives and procedures, candidates were invited to partic- 
ipate and complete the questionnaires. All participants 
signed informed consent before the study began. Study par- 
ticipation was voluntary and anonymous. 

The physician collected the variables related to the can- 
cer and its treatment. Sociodemographic and psychological 
data were obtained directly from the patient. The question- 
naires were taken up individually during a one-hour session. 
This visit was structured according to the standard practice 
at each center, although it was generally agreed that at the 
very least, the risk of relapse, options for adjuvant treatment, 
risk of adverse effects, and possible efficacy of the therapy 
should be discussed with the patient. 

Participants were informed that no answers were better 
or worse to the questions and that all answers should be 
chosen on the basis of their own experiences. Special atten- 
tion was paid to ensure data privacy and confidentiality and 
to avoid random answers. The information was gathered and 
updated by physicians experienced in cancer, who were 
trained to comply with the study requirements, through a 
web-based platform (www.neocoping.es).Telephone data 
monitoring was performed at all centers. Patients completed 
the scale at baseline and were followed-up throughout adju- 
vant treatment. 


LSS adaptation process 


The aim of the process of adaptation was to keep the 
wording of the Spanish version as similar as possible to the 
original version (LSS) to minimize any differences in item in- 
terpretation between both versions. We used the guidelines 
described for Hambleton, Merenda, and Spielberger (2005) 
for the process of cross-cultural adaptation of self-reported 
measures. Specifically, for the translation, two independent 
bilingual translators, competent in both English and Spanish, 
translated the original questionnaire from English into Span- 
ish. Translators reached consensus on the translation of 
words, phrases and items based on the synthesis of the trans- 
lations, working from the original questionnaire as well as 
the first translator’s and the second translator’s versions. For 
cultural appropriateness and content validity, four independ- 
ent physicians and psychologist performed testing. They rat- 
ed understandability, translation equivalences and content 
validity. Another two bilingual translators who were blind to 
the original English version back translated the revised Span- 
ish version, and finally, the study directors compared and 
synthesized the back-translation with original questionnaire, 
culminating in a final version (see appendix A). The final 
version was pre-test with the first thirty-four adult patients 
attended who were invited to participate in this study. Their 
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responses were analyzed to identify necessary modifications; 
however, it was not necessary to make any modification after 
this pre-test. 


Assessments 


Liverpool Stoicism Scale (LSS, Wagstaff & Rowledge, 1995). 
The LSS is a self-reported questionnaire designed to measure 
stoicism; it consists of 20 items whose content refers to lack 
of emotional involvement, dislike for openly expressing 
emotion, and the ability to withstand emotion. Responses 
were recorded on a 5-point Likert scale ranging from strongly 
disagree to strongly agree. To prevent response bias, half of the 
questions were posed in such a way that agreement was syn- 
onymous with high stoicism, whereas for the other half, dis- 
agreement indicated a high level of stoicism. The answers to 
these questions were evaluated in reverse. Ten items (1, 2, 5, 
7, 9, 12, 13, 15, 17, and 18) are reverse-scored. The mini- 
mum sum score is 20 and the maximum is 100. Higher 
scores indicate greater stoicism levels. The original version is 
reported to have acceptable internal consistency (Cronbach’s 
alpha = .83; Wagstaff & Rowledge, 1995). 

Big Five Inventory (BFI-10, Rammstedt & John, 2007). The 
BFI-10 is an abbreviated version of the well-established Big 
Five Inventory; for the Spanish version see Benet-Martinez 
and John (1998). The BFI identifies five traits (Introversion 
[I], Neuroticism [N], Openness to experience [O], Agreea- 
bleness [A], and Conscientiousness [C]). BFI traits are meas- 
ured on 10 items and rated on a five-point scale from 1 “disa- 
gree strongly’ to 5 “agree strongly’. The minimum sum score is 10 
and the maximum is 50. It has been reported to have good 
psychometric properties (coefficient alpha reliabilities ranged 
from .75 to .90 and average.83; Rammstedt, Goldberg, & 
Borg, 2010). 

The remaining variables consisted of demographic data 
(e.g. age, marital status, education level, number of children, 
primary studies, working now, family history of cancer) and 
medical information (type and stage of cancer, Eastern Co- 
operative Oncology Group Performance Status (ECOG-PS), 
and the characteristics of adjuvant treatment chemotherapy 
with or without radiotherapy). 


Statistical Analyses 


Previous descriptive statistics showed that the item dis- 
tributions were generally asymmetrical and some of them 
had skewness coefficients larger than one. Furthermore, giv- 
en that the test is not too long and the sample is reasonably 
large, we considered that the best choice was to use the un- 
derlying-variables approach, and fit the Factor Analysis (FA) 
model to the inter-item polychoric correlation matrix (see 
Ferrando & Lorenzo-Seva, 2014). In this approach what we 
are fitting is Samejima’s (1969) normal-ogive graded re- 
sponse model using an FA parameterization. 

In accordance with previous studies, models going from 
1 to 4 factors were fitted to the data. The initial solutions 
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were obtained by using Robust Unweighted Least Squares 
(RULS) estimation with mean-corrected fit statistics as im- 
plemented in the FACTOR program (Lorenzo-Seva & Fer- 
rando, 2006). Assessment of model-data fit was based on the 
Root mean squared error of approximation (RMSEA) as a 
measure of approximate fit; the Goodness-of-fit index (GFT) 
and the Root Mean Square of Residuals (RMSR), as absolute 
measures of fit; and the non-normed fit index (NNED as a 
relative measure of fit with respect to the null independence 
model (see e.g. Lloret-Segura, Ferreres-Traver, Hernandez- 
Baeza, & Tomás-Marco, 2014). As additional indices for de- 
termining dimensionality we used Optimal implementation 
of parallel analysis (Timmerman & Lorenzo-Seva, 2011) and 
Schwarz’s Bayesian Information Criterion (BIC). Initial ca- 
nonical solutions were next rotated to achieve maximum fac- 
tor simplicity using the Promin criterion (Lorenzo-Seva, 
1999). 

Once the item set had been calibrated, fully Informative 
prior Oblique expected-a-posteriory (EAP) scores (ORION) 
together with their corresponding marginal reliability esti- 
mates were obtained (Ferrando & Lorenzo-Seva, 2016). 

We turn now to the validity assessment. In the correla- 
tional-analyses part, we first fitted a multiple linear regression 
analysis to assess the extent to which personality scores in 
the 5 scales were able to predict LSS-based stoicism scores. 
Next, for those predictors found statistically significant, the 
bivariate correlations between the LSS scores and the cotre- 
sponding personality scores were obtained. These bivariate 
correlations can be interpreted as convergent validity coeffi- 
cients. In addition, the disattenuated correlation was also es- 
timated in order to assess the theoretical relation free from 
measurement errors. 

For the remaining variables, independent-sample t-test 
were performed to compare mean stoicism scores in men vs. 
women. In addition, we also obtained the correlations be- 
tween age and stoicism scores. All the validity analyses were 
conducted using SPSS v23.0 (SPSS Inc., Chicago, IL) for 
Windows. 


Results 
LSS internal analyses 


The first columns in table 2 show the means and stand- 
ard deviations of the LSS items. The mean for the total scale 
scores was 56 (SD =7.6, range 30-80). The mean score on 
the original stoicism scale for the British sample (Wagstaff & 
Rowledge, 1995) was 52.2 (SD =13.2, n = 62), the mean on 
Australian version (Murray et al., 2008) was 54,9 (SD = 9,6, n 
= 469), the mean on the Latvian version (Gaitniece-Putane, 
2005) was 68.3 (SD =9.1, n =195). The mean stoicism score 
in our sample was significantly higher than the British sam- 
ple, £ (503) = 2.216, p =.030, similar than Australian sample / 
(469) = 1.924, p =.055, and lower than the Latvia sample, ¢ (636) 
= -16.509, p <.001. 

We turn now to factor analysis results. Results from the 
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KMO test (.75) and Bartlett's test (y2 (190, =1635.7, p <.001) 
suggested that the inter-item relations were consistent 
enough to be fitted by the FA model. 

Results of optimal implementation of Parallel Analysis 
suggested that 4 was the most appropriate number of fac- 
tors. The remaining results are in table 2. Note that BIC 
reaches its minimum at 4 factors, and also that the four- 


Table 2. Results of Optimal Implementation of Parallel Analysis (PA). 


factor solution is the only one that leads to acceptable fit ac- 
cording to all criteria. Given these results we tentatively ac- 
cept the 4-factor solution as the most appropriate. It should 
be noted that solutions in more factors were also tried but 
they were non-interpretable given the reduced number of 
variables loading in each factor. 


Factor % explained variance RMSEA GFI RMSR NFFI BIC 

One factor 20.6 107 850 114 .707 1267.850 
Two factors 32.8 .080 935 078 836 940.533 
Three factors 40.9 .066 961 060 889 873.856 
Four Factors 48.7 .050 979 050 937 851.267 


Abbreviations. RMSEA: Root Mean Square Error of Approximation, GFI: Goodness-of-fit index, RMSR: Root Mean Square of Residuals, NNFI: Non- 


normed fit index, BIC: Schwarz’s Bayesian Information Criterion. 


For the sake of comparison, we also note that the 4- 
factor solution obtained here accounted for a 48.6% of the 
total variance, which, as expected, is higher than those ob- 
tained in previous studies: 37.9% with three factors in Latvia 
(Gaitniece-Putane, 2005); 25.9% with one factor in Australia 
(Murray et al., 2008), and slightly higher than British sample 
(47%) that has four factors (Furnham et al., 2003). 

Interpretation of an unrestricted factor solution is gener- 
ally based on salience rules that are highly dependent on 
sample size (see e.g. Lloret-Segura et al. 2014). In our case, 
with a sample of 443 respondents, the approximate standard 
error of a loading is about 0.04. So, the standard recommen- 
dation by McDonald (2014) that, in a reasonably large sam- 
ple a minimum of 3 indicators with loadings above 0.30 are 
needed to define a factor seems appropriate. 

The pattern of salient loadings corresponding to the 4- 
factor solution are in the last columns of table 3, and the re- 
sults can be summarized as follows: the first factor involved 
items about emotional concealment, items 4, 6, 8, 10, 19, 14, 
(e.g., I tend not to express my emotions’), the second refers 
to a favorable attitude toward expressing emotions, defined 
by items 7, 11, 12, 13, 15, 18, 20, that (e.g., * is healthy to ex- 
press one's emotions”), the third is about problem sharing, 
items 5, 9, 16, 17 (e.g., I would not mind sharing my prob- 
lems’) and the fourth revolve around sentimentality, items 1 
and 2 (e.g., ‘I tend to cry at sad films”. The estimated mar- 
ginal reliabilities of the corresponding ORION factor scores 
(see Ferrando & Lorenzo-Seva, 2016) were: factor 1 (.78), 
factor 2 (.85), factor 3 (.88) and factor 4 (.81). 

Even though the solution described above is relatively 
clear and yields reasonable reliability estimates (given the re- 
duced number of items), some problems that will be further 
discussed are apparent. At the column level, the fourth fac- 


tor is, at best, a minor factor under-identified. And, if the 
pattern is assessed at the item level, we find that two items (3 
and 14) do not strictly reach minimal salience. Item 14 (One 
should keep a ‘stiff upper lip’) is a complex point that 
demonstrate the ability to endure hardship, more representa- 
tive of factor 1, but also with small loads in factor 2 and 3. 
Item 3 (1 do not let me problems interfere with my everyday 
life”), has very low loading, and do not belong to any factor. 
As described here, stoicism refers specially to mastering one’ 
subjective responses and so, item 3 has dubious face validity. 

The inter-factor correlation matrix contained positive 
correlations in all cases that ranged from .16 to .45. A se- 
cond-order factor analysis fitted well this matrix (RMSR= 
.05, GFI= .98), which suggests that LSS total scores could be 
treated as measures of a general factor of stoicism as initially 
intended. To further assess this issue, the loadings on the 
first canonical factor were also obtained. They are in the 
third column of table 3. We note that the first canonical so- 
lution exhibits positive manifold, and that 11 loadings are 
above 0.30. To further assess this issue we also obtained the 
expected common variance index (ECV; see Rodriguez, Rei- 
se, & Haviland, 2016) using the canonical solution in one 
factor and the canonical solution in 4 factors. The ECV val- 
ue was 0.47 which means that, of all the common variance 
explained by the 4-factor solution, 47% was already ex- 
plained by the first general factor. Overall, we believe that 
these results suggest that the factors obtained in the 4-factor 
solution can also be viewed as facets of a more general di- 
mension of stoicism. However, as discussed below, this issue 
also deserves further research. If the total scores are used, as 
we shall do in the validity analyses that follow, the reliability 
estimate for the ORION scotes is .90, while the omega reli- 
ability estimate for the raw scores is .77. 
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Table 3. Mean, Standard deviation, multidimensional item discrimination, and factor loadings of the LSS items. 


Questions? 


M SD œc Fact1 Fact2 Fact3 Fact 4 


4 I tend not to express my emotions 
8 I tend to keep my feelings to myself 


10 It makes me uncomfortable when people express their emotions in front of me 


19 I would not cry at the funeral of a close friend or relative 


6 Ido not get emotionally involved when I see suffering on television 


14 One should keep a ‘stiff upper lip’ 

3 Ido not let me problems interfere with my everyday life 

15 I believe that it is healthy to express one’s emotions* 

12 1 rely heavily on my friends for emotional support* 

20 Expressing one’s emotions is a sign of weakness 

18 A problem shared is a problem halved* 

11 I don’t really like people to know what I am feeling 

13 L always take time out to discuss problems with my family* 
7 I would consider going to a counselor if I had a problem* 
17 I would not mind sharing my problems with a female friend* 
16 Getting upset over the death of a loved one does not help 
9 I would not mind sharing my problems with a male friend* 
5 I like someone to hold me when I am upset* 

1 I tend to cry at sad films* 

2 I sometimes cry in public* 


2.47 1.26 .273 -570 
2.88 1.50 .032 .458  .353 
2.50 1.41 .109 .458  .326 
2.65 1.68 .224 .430 
2.49 1.43 .239 .412 


3:12: 123-155 2293: 2214 .272 
2.18 1.21 .278 .267 

3.77 1.01 .603 676 

3.67 1.37 .620 .651 

1.65 1.06 .197 548 —.335 

3.15 1.71 .627 512 425 

1.75 .93 .202 498 

3.18 1.27 .534 481 

3.03 1.96 .534 346 

2.69 1.95 .470 802 

2.38 1.90 .316 595 

2.75 1.74 .523 483 

2.42 2.01 .525 330 

2.30 1.69 .486 .828 
1.63 .77  .448 .750 


Notes. * Score range from 1 (strongly-disagree) to 5 (strongly-agree). * Items scored in reverse. 
Abbreviations. M: mean; SD: Standard Deviation; « loadings in the first canonical factor. 


Validity evidence 


Patients in our sample showed higher scores on the 
agreeableness and conscientiousness scales of the BFI, that 
is, patients were kind and grateful, and were very involved in 
their treatment. Results of the linear regression suggested 
that, as of the five personality factors of BFI-10 (introver- 
sion, neuroticism, openness to experience, agreeableness, 
conscientiousness), only introversion had a significant 
weight, and was able to account for 4.1% of the variance in 
the stoicism scores (F (1401) = 18.397, p <.001). The conver- 
gent validity coefficient between the total LSS scores and the 
BFI introversion scores was fy =.281, and the correspond- 
ing disattenuated estimate was .35. 


Differences in clinical and social variables related to 
stoicism 


As expected, LSS scores were significantly higher for 
males (M = 57.1, SD = 7.7) than females (M = 55.2, SD = 
7.5, fa441) = 2.436, p =.015, Cohen’s d = .25), although effect 
sizes are small. Further, stoicism was positively associated 
with age (r = .304, p < .001). 


Discussion 


The results of this study suggest that stoicism is an interest- 
ing and potentially useful dimension in further research in 
the field of oncology. The instrument analyzed, the LSS, has 
shortcomings and points that should be improved, but in 
principle exhibited acceptable psychometric properties in- 
cluding meaningful relations with age, gender, and with the 
personality dimension of introversion which went in the ex- 
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pected direction. These findings can have implications for 
routine clinical practice. In our study, cancer patients who 
had undergone surgery exhibited moderate stoicism scores, 
higher than the British sample (Wagstaff & Rowledge, 1995), 
similar than Australian sample (Murray et al., 2008), and 
lower the Latvian sample (Gaitniece-Putane, 2005). These 
discrepancies could be explained in relation to three aspects: 
a) cultural influence, 2) age, the Australian sample were mid- 
dle-aged, similar to ours, and older than participants in the 
other studies, and 3) the clinical setting, in our series consist- 
ed solely of patients who had just recovered from major sut- 
gery for a non-metastatic cancer facing a difficult decision 
about adjuvant therapy, whereas the British, Australian and 
Latvian samples comprised healthy individuals. 

As far as the internal analysis is concerned, the Spanish 
version of the LSS has a structure compatible with a four- 
factor solution, and the resulting subscales have acceptable 
reliabilities for practical use. At a higher level, this solution is 
also compatible with a general dimension of stoicism, and 
the scores derived from the general solution are highly relia- 
ble. However, at least two items showed low discriminating 
power in our study, and the fourth factor was essentially a 
doublet. Further studies are required in order to decide (a) 
the convenience of omitting or re-writing certain items, and 
(b) whether the fourth factor has theoretical relevance or 
merely reflects content specificity in the two implied items. 
Regarding point (a), items referred to emotional concealment 
or repression had lower discriminating power and, items 3 
and 14 had very low factor loadings; in fact, the content of 
item 3 (I do not let my problems interfere with my everyday 
life”) is unique in not referring to emotions. Murray et al. 
(2008) suggested remove this item, and use a 19-item LSS. 

As far as the scoring schema is concerned, whether it is 
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more appropriate to use subscale scores or total scores in 
clinical assessment is an issue that requires further research. 
Although total scores behaved appropriately in our study, 
this schema necessarily implies a lost of information, and so, 
subscale scores, even when less reliable, might result in valid- 
ity improvements. Furthermore, even if the total scores are 
to be used, the results obtained here suggest that fully- 
informative EAP scores ate far more reliable than simple- 
sum total scores. So, even though the scoring schema is 
more complex, it would be recommendable to use these 
more accurate scores. To sum up, a revision of the scale is 
recommendable not only to improve its psychometric prop- 
erties but also to make it easier for patients to comprehend. 

The validity analyses suggested that the personality trait 
that best predicted stoicism was introversion. More intro- 
verted individuals prefer solitude; they tend to be uneasy in 
social relationships, which limits their chances to share expe- 
riences, emotions, and talk about their feelings with others; 
hence, the result that they have higher stoicism levels seems 
to be meaningful. Cancer patients overall show a higher level 
of introversion compared with control groups (Cardenal, Ce- 
rezo, Martinez, Ortiz-Tallo, & Blanca, 2012). Introversion 
and stoic acceptance of events negatively correlates with ac- 
tive coping (Giese-Davis, Conrad, Nourianai, & Spiegel, 
2008; Panayiotou, Kokkinos, & Kapsou, 2014; Rana, 
Gellrich, Czens, Kanatas, & Rana, 2014). 

Also as expected, stoicism was greater in older patients. 
It is possible that stoicism increases as part of age-related 
maturity, due to increased acceptance of loss as inevitable 
(Judd et al., 2006). Likewise, there are authors who have ex- 
plained it as a cohort effect; that is, that older individuals 
have grown up in a culture that values abnegation and resig- 
nation (Corboy, McLaren, Jenkins, & McDonald, 2014; 
Stewart & Harmon, 2004; Wrigley, Jackson, Judd, & Komiti, 
2005), as well as stoical attitudes, for instance as regards 
pain, and the propensity to hide it and not seek help to avoid 
appearing weak (Judd et al., 2006; Yong, 2006). 

There are several limitations to this study. First, despite 
using a larger sample than other published studies, the num- 
ber of patients recruited is still rather small for subgroup 
analyses to be conducted based on tumor location. Thus, the 
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Appendix A. Spanish version of Liverpool Stoicism scale 


*1. Suelo llorar viendo películas tristes 
*2. A veces lloro en público 
3. No dejo que mis problemas interfieran en mi vida privada 
4. No suelo expresar mis emociones 
*5, Me gusta que me abracen cuando estoy enfadado/a 
6. No me siento afectado emocionalmente cuando veo sufrir en TV 
*7. Iria al psicólogo si tuviera problemas 
8. Suelo guardar mis sentimientos 
*9. No me importa compartir mis problemas con un amigo 
10. No me gusta que la gente sepa lo que siento 
11. Me siento incómodo cuando la gente me expresa sus sentimientos 
*12. Confío en el apoyo emocional de mis amigos 
*13. Me tomo mi tiempo para discutir los problemas con mi familia 
14. Se debe mantener las formas en público 
*15. Es saludable expresar las propias emociones 
16. Sentirse enojado por la muerte de un ser querido no ayuda 
*17. No me importa compartir mis problemas con una amiga 
*18. Un problema compartido es un problema reducido a la mitad 
19. No suelo llorar en el funeral de un familiar o amigo 
20. Expresar los sentimientos es un signo de debilidad 
The format of a five-point Likert scale was: 1 (strongly-disagree), 2 (disagree), 3 (neither agree nor disagree), 4 (agree), and 5 (strongly-agree). 
* Items that are scored in reverse 
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